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Amendments to the Claims: 

Please cancel claims 2-8, amend claims 1, 9, 10 and 1 1, and add claims 12-32 
as shown in the following listing of claims. This listing of claims will replace all 

5 prior versions, and listings, of claims in the application. 

J 1 . (currently amended) An omni-directional image and 3-Dimensional data 

2 acquisition apparatus, comprising: 

3 a plurality of multi-camera modules positioned alonp the direction of 

4 height each of the a-multi-camcra modul e modules including multiple construct e d in 

5 u mann e r comprising a plurali ty-ef cameras that are symmetrically arranged-with-a 

6 sp e cific point in a plan e such that the optical centers of the multiple cameras are in a 

7 plane, the multiple cameras of the multi-camera modules being further arranged such 

8 that the optical axis of at least one of the multiple cameras from a first multi-camera 

9 module of the multi-camera modules at a first height is pointing in the same direction 

10 as the optical axis of at least one of the multiple cameras from a second multi-camera 

11 module of the multi-camera modules at a second height such that the optical axes are 

12 parallel: and , e aoh of th e cameras talcing charge of eaoh of divided angles s uch that 

13 th e cam e ra modul e can toko an omni directional continuous panoramic photograph of 

14 surrounding objoots with tho specific point; 

15 a vision computer system operativelv connected to each of the multiple 
[6 cameras of the multi-camera modules, the vision computer system being configured 

17 to process and store images acquired by the multiple cameras. 

18 first fram e grabb e rs each of which ia e l e ctrically connected to each of 

19 the cameras of tho multi oomora modulo, to grab photographed images by fram e s; 

20 an e xpooure oaloulator electrically oonnooted to tho first frame 

21 grabb e rs, to calculate exposure of eaoh oam e ra, based on th e grabb e d imag e s by 

22 frames; 
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23 an e xposure signal g e nerator el e ctrically conn e ct e d to OQOh camera, to 

24 transmit information about the axposur e as a signal on tho basis of the expo sure 

25 calculat e d by tho exposure oaloulator; 

26 atorago means e l e otrioally conn e cted to th e e ach firnt frame grabber, to 

27 stor e imag e s photograph e d by th e camerao according to photographing location and 

28 photographing tim e ; - 

29 a GPS s e nsor to oona e th e photographing location and photographing 
30 . tinie^ 

31 an annotation entering unit eleotrioally conn e ct e d to tho GPS sensor to 

32 calculat e location and time corr e sponding to e ach frame bas e d on a e naed data of the 

33 GP S ooncor^ th e annotation e ntering unit being e lectrically oonnootod to th e storag e 

34 m e ans to enter tho calculated location and time4n- each fram e as annotation; and 

35 a trigg e r signal g e nerator electrically oonnootod the storage mcan sHhe 

36 e xposur e signal generator, tho annotation entering unit, th e trigg e r signal g e n e rator 

37 s e l e ctively tranomitfi a trigger signal to tho oxpofluro s ignal g e nerator or th e annototi ea 

38 e nt e ring unit in order that tho cam e ras s tart to photograph th e objects according to the 

39 trigger signal; and vvhoroin the multi camera modulo aro vertically s tacked and 

40 formed in at l e ast two lay e rs in th e dir e ction of h e ight. 

I 2. (canceled). 

1 3> (canceled), 

l 4. (canceled). 

1 5. (canceled). 

J 6. (canceled), 

l 7. (canceled). 

Attorney Hock* No, 1772-4 3 

Serial No. I (V07 1,915 Ariieuilfncni and Response to Office Action 



PAGE 7122 * RCVD AT 1017/2005 8:30:48 PM [Eastern Daylight Time] * SVR:USPTO£FXRF-6/24 * DNIS:2738300 ' CSID:92524901 1 1 * DURATION (mm-ss):07-02 



SENT BY:. WILSON & HAM; 



9252490111 ; 



OCT- 7- 05 4:56PM; 



PAGE fi 



I 8. (canceled), 

1 9, (currently amended) A method for acquiring 3-dimensional data , the method 

2 comprising- th e st e ps of : 

3 acquiring first images using a multi-camera module comprising 

4 multiple c ameras, including using at least some of the multiple cameras with the 

5 optical centers in a first plane at a first height to acquire the first ima ges; 

6 acquiring second images using the multi-camera module, including 

7 using at least some of the multiple cameras with the optical centers in a second plane 
$ at a second height to acq uire the second images the second plane being parallel to the 

9 first plane; 

1 0 searching-*** corresponding points in one of the first images and in 

11 one of the second images each im age: 

1 2 extracting-^? distance information for the corresponding points using 

13 trigonometry; and 

14 acquiring-fe* 3-dimensional data based on the distance information. 



1 1 0. (currently amended) A method for extending dynamic range of images, 

2 comprising the steps of: 

3 acquiring for-am te multiple images of an object, thenaatt i multiple 

4 images being photographed by the-cameras of a multi-camera module which have 

5 different exposur e amounts amount each oth e r f wherei n the cameras- t h e roulli cam e ra 

6 module comprising n plurality of cam e ras which are symmetrically arranged at a 

7 specific point in a plane, and which take charge of each allocating viewing angle 

8 calculated by 360° divided by the number of the cameras; 

9 selectively extracting for regions in the-amlri multiple images* wherein 

10 the regions are included within the dynamic range of the camera s camera: and 

1 1 acquiring for images of dynamic range extension, which are generated 

12 by composing the extracting regions. 
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1 11. (currently amended) An omni-directional image and 3-Dimensional data 

2 acquisition apparatus, comprising: 

3 a mill t i -camera modul e includin g oonotructed in a manner comprised 

4 of a plurality of multiple cameras that ar e symmetrically arrange d with a specific 

5 point in a plane such that the optical centers of the cameras are in a plane , each of th e 
<5 cameras taking charg e of oooh of divid e d angles such that th e oomora module con talco 

7 on orrmi directional continuous panoramic photograph of aurrounding obj e oto with 

8 th e sp e cific p oin t ; 

9 an elevator for elevating the multi-camera module vertically; and 

10 a vision computer system operativelv connected to each of the multiple 

11 cameras of the multi-camera modules, the vision computer system being configured 

12 to process and store images acquired by the multiple cameras. 

13 first firamo grabb e rs e ach of which js-electricall y conn e ct e d to each of 

14 tho cameras of tho multi - camera modulo, to grab photographed imag e o by frames; 

15 an e xposure calculator e l e ctrically conn e ct e d to tho first frame 

16 grabbers, to calculat e e xposure - of each oom e ra, based on the grabb e d images by 

1 *7 r**± A *? * 

18 an e xposure signal g e nerator olootrioally conn e ct e d to each cam e ra, to 

19 transmit information about th e exposure as a s ignal on th e basi s of th e e xpo s ure 

20 calculat e d by the exposure calculator; 

21 storage moans electrically connected to th e e ach first fram e grabb e r, to 

22 store imag e s photograph e d by th e cameras according to photographing location and 

23 photographing tim e ; 

24 a GPS s e nsor to senso tho photographing location and photographing 

23 tXii.i.0^ 

26 an annotation ent e ring unit electrically connected to tho GP S oonoor to 

27 calculate location and tim e corr e sponding to e ach fram e bas e d on sensed data of tho 

28 GPS s e nsor, tho annotation e nt e ring unit boing e l e ctrically connected to th e storage 

29 m e ans to e nt e r th e calculated location and tim e in e ach fram e as annotation; and 
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30 a trigg e r signal generator electrically conn e ct e d th e storage mcana, the 

31 expoouro signal generator, the ann o ta t ion entering unit, tfao trigger oignal gen erate* 

32 selectively transmit*) a trigg e r signal to tho exposure signal generator or the annotation 

33 e nt e ring unit in order that th e onm o ras start to photograph tho obj e cts aooording to the 

34 trigger signal 

1 12. (new) The apparatus of claim I , wherein the optical axes of the multiple 

2 cameras of the first multi-camera module are in a first plane and the optical axes of 

3 the multiple cameras of the second multi-camera module are in a second plane, the 

4 first and second planes being parallel to each other and perpendicular to the direction 

5 of height 

1 13. (new) The apparatus of claim 1, wherein each of the optical centers of the 

2 multiple cameras of the first multi-camera module is vertically aligned with one of 

3 the optical centers of the multiple cameras of the second multi-camera module, 

1 1 4. (new) The apparatus of claim 1 3, wherein the optical axis of each of the 

2 multiple cameras of the first multi-camera module is parallel to the optical axis of a 

3 camera of the second multi-camera module that is vertically aligned with that 

4 multiple camera of the first multi-camera module. 

1 15. (new) The apparatus of claim 1 3, wherein the optical axes of the multiple 

2 cameras of the first multi-camera module are in a first plane and the optical axes of 

3 the multiple cameras of the second multi-camera module are in a second plane, the 

4 first and second planes being parallel to each other and perpendicular to the direction 

5 of height. 

1 16. (new) The apparatus of claim 1, wherein the plurality of multi-camera module 

2 includes a third multi-camera module at a third height. 
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1 17, (new) The method of claim 9, further comprising elevating the multi-camera 

2 module so that the optical centers of at least some of the cameras of the multi-camera 

3 module are moved from the first plane to the second plane to capture the first and 

4 second images. 

1 1 8. (new) The method of claim 1 7, wherein the acquiring the second images 

2 includes acquiring the second images using cameras of the multi-camera module that 

3 differ from cameras of the multi-camera module used to acquire the first images. 

1 19. (new) The method of claim 9, wherein each of the optical centers in the first 

2 plane is vertically aligned with one of the optical centers in the second plane. 

1 20. (new) The method of claim 19, wherein the optical axis corresponding to each 

2 of the optical centers in the first plane is parallel to the optical axis corresponding to 

3 one of the optical centers in the second plane that is vertical aligned with that optical 

4 center, 

1 21, (new) The method of claim 9> wherein the optical axes corresponding to the 

2 optical centers in the first plane are parallel to the optical axes corresponding to the 

3 optical centers in the second plane. 

1 22 4 (new) The method of claim % wherein the first plane and the second plane arc 

2 perpendicular to the direction of height. 

1 23. (new) The method of claim 9, further comprising acquiring third images using 

2 the multi-camera module, including using at least some of the multiple cameras with 

3 the optical centers in a third plane at a third height to acquire the third images. 

1 24, (new) The apparatus of claim 1 1 , wherein the optical axes of the multiple 

2 cameras of the multi-camera module are in the plane. 
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1 25. (new) The apparatus of claim 1 1 , wherein the multiple cameras of the multi- 

2 camera module are symmetrically arranged about a center point in the plane. 

1 26. (new) A method for acquiring 3-dimensional data, the method comprising: 

2 acquiring first images using a multi-camera module comprising 

3 multiple cameras at a first location, the optical centers of the multiple cameras being 

4 in a plane; 

5 moving the multi-camera module from the first location to a second 

6 location; 

7 acquiring second images using the multi-camera module at the second 

8 location; 

9 searching corresponding points in at least one of the first images and in 

10 at least one of the second images; 

1 1 extracting distance information for the corresponding points using 

1 2 trigonometry; and 

13 acquiring 3-dimensional data based on the distance information. 

1 27. The method of claim 26 wherein moving the multi-camera module includes 

2 moving the multi-camera module along a horizontal direction. 

1 28. The method of claim 26 wherein moving the multi-camera module includes 

2 moving the multi-camera module along a vertical direction. 

1 29, The method of claim 26 further comprising acquiring additional first images 

2 using additional cameras of the multi-camera module at the first location, the optical 

3 centers of the additional cameras being a different height than the optical centers of 

4 the multiple cameras, and wherein searching the corresponding points further 

5 includes searching the corresponding points in at least one of the additional first 

6 images. 
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1 30. (new) An omni-directional image and 3 -Dimensional data acquisition 

2 apparatus, comprising: 

3 a plurality of multi-camera modules, each multi-camera module 

4 constructed in a manner comprising a plurality of cameras that are symmetrically 

5 arranged with a specific point in a plane, each of the cameras taking charge of each of 

6 divided angles such that each multi-camera module can take an omni-directional 

7 continuous panoramic photograph of surrounding objects with the specific point; 

8 first frame grabbers each of which is electrically connected to each of 

9 the cameras of each multi -camera module, to grab photographed images by frames; 

1 0 an exposure calculator electrically connected to the first frame 

1 1 grabbers, to calculate exposure of each camera, based on the grabbed images by 

12 frames; 

1 3 an exposure signal generator electrically connected to each camera, to 

14 transmit information about the exposure as a signal on the basis of the exposure 

1 5 calculated by the exposure calculator; 

16 a plurality of light intensity sensors electrically connected to the 

1 7 exposure calculator to allow the exposure calculator to be able to calculate the 

1 8 exposure amount of the each camera based on external light intensity; 

1 9 storage means electrically connected to the each first frame grabber, to 

20 store images photographed by the cameras according to photographing location and 

2 1 photographing time; 

22 a GPS sensor to sense the photographing location and photographing 

23 time; 

24 an annotation entering unit electrically connected to the GPS sensor to 

25 calculate location and time corresponding to each frame based on sensed data of the 

26 GPS sensor, the annotation entering unit being electrically connected to the storage 

27 means to enter the calculated location and time in each frame as annotation; and 

28 a trigger signal generator electrically connected the storage means, the 

29 exposure signal generator, the annotation entering unit, the trigger signal generator 

30 selectively transmits a trigger signal to the exposure signal generator or the annotation 
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31 entering unit in order that the cameras start to photograph the objects according to the 

32 trigger signal; and wherein the multi-camera modules are vertically stacked and 

33 formed in at least two layers in the direction of height. 

1 3 K (new) An omni-directional image and 3-Dimensional data acquisition 

2 apparatus, comprising: 

3 a plurality of multi-camera modules, each multi-camera module 

4 constructed in a manner comprising a plurality of cameras that are symmetrically 

5 arranged with a specific point in a plane, each of the cameras taking charge of each of 

6 divided angles such that each multi-camera module can take an omni-directional 

7 continuous panoramic photograph of surrounding objects with the specific point; 

8 first frame grabbers each of which i$ electrically connected to each of 

9 the cameras of each multi-camera module, to grab photographed images by frames; 
to an exposure calculator electrically connected to the first frame 

1 1 grabbers, to calculate exposure of each camera, based on the grabbed images by 

12 frames; 

13 an exposure signal generator electrically connected to each camera, to 

14 transmit information about the exposure as a signal on the basis of the exposure 

1 5 calculated by the exposure calculator, 

16 storage means electrically connected to the each first frame grabber, to 
] 7 store images photographed by the cameras according to photographing location and 
18 photographing time; 

t9 a video camera electrically connected to the storage means via a 

20 second frame grabber for grabbing photographed moving pictures by frames, to the 

21 storage means a unique video clip corresponding to each image or image group to be 

22 stored in the storage means; 

23 a GPS sensor to sense the photographing location and photographing 

24 time; 

25 an annotation entering unit electrically connected to the GPS sensor to 

26 calculate location and time corresponding to each frame based on sensed data of the 
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27 GPS sensor, the annotation entering unit being electrically connected to the storage 
2S means to enter the calculated location and time in each frame as annotation; and 

29 a trigger signal generator electrically connected the storage means, the 

30 exposure signal generator, the annotation entering unit, the trigger signal generator 

3 1 selectively transmits a trigger signal to the exposure signal generator or the annotation 

32 entering unit in order that the cameras start to photograph the objects according to the 

33 trigger signal; and wherein the multi-camera modules are vertically stacked and 

34 formed in at least two layers in the direction of height. 

1 32. (new) An omni-directionaJ image and 3-Dimensional data acquisition 

2 apparatus, comprising; 

3 a plurality of multi-camera modules, each multiH?amera module 

4 constructed in a manner comprising a plurality of cameras that are symmetrically 

5 arranged with a specific point in a plane, each of the cameras taking charge of each of 

6 divided angles such that each multi-camera module can take an omni-directional 

7 continuous panoramic photograph of surrounding objects with the specific point; 

8 first frame grabbers each of which is electrically connected to each of 

9 the cameras of each multi-camera module, to grab photographed images by frames; 
i o an exposure calculator electrically connected to the first frame 

1 1 grabbers, to calculate exposure of each camera, based on the grabbed images by 

12 frames; 

13 an exposure signal generator electrically connected to each camera, to 

14 transmit information about the exposure as a signal on the basis of the exposure 

1 5 calculated by the exposure calculator; 

1 6 storage means electrically connected to the each first frame grabber, to 
] 7 store images photographed by the cameras according to photographing location and 

I 8 photographing time; 

1 9 a distance sensor and a direction sensor for respectively sensing the 

20 distance and direction of the image photographed by each camera; 
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2 1 a GPS sensor to sense the photographing location and photographing 

22 time; 

23 an annotation entering unit electrically connected to the GPS sensor to 

24 calculate location and time corresponding to each frame based on sensed data of the 

25 GPS sensor, the annotation entering unit being electrically connected to the storage 

26 means to enter the calculated location and time in each frame as annotation; and 

27 a trigger signal generator electrically connected the storage means, the 

28 exposure signal generator, the annotation entering unit, the trigger signal generator 

29 selectively transmits a trigger signal to the exposure signal generator or the annotation 

30 entering unit in order that the cameras start to photograph the objects according to the 

3 1 trigger signal; and wherein the multi-camera modules are vertically stacked and 

32 formed in at least two layers in the direction of height. 
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